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00 

O 
o 

(N 



U 
O 



> 

(N 
O 
oo 
O 



J. William Helton and Jiawang Nie 

Department of Mathematics 
University of California, San Diego 
lielton@matli.ucsd.edu, njw@matli.ucsd.edu 

February 10, 2008 



Abstract 

Linear matrix Inequalities (LMIs) have had a 
major impact on control but formulating a prob- 
lem as an LMI is an art. Recently there is the be- 
ginnings of a theory of which problems are in fact 
expressible as LMIs. For optimization purposes 
it can also be useful to have "lifts" which are 
expressible as LMIs. We show here that this is 
a much less restrictive condition and give meth- 
ods for actually constructing lifts and their LMI 
representation. 

1 Introduction 



Recently, there is a lot of work [LasOll INDOSj 
INDS061 lPa?00l IParStu03] in solving global poly- 
nomial optimization problems by using sum of 
squares (SOS) methods or semidefinite program- 
ming (SDP) relaxations. The basic idea is to 
approximate a semialgebraic set 5 by a collec- 
tion of convex sets called SDP relaxations each 
of which has an SDP representation. This leads 
to the fundamental problem of which sets can be 
represented with LMIs or projections of LMIs. 

A set S is said to have an LMI representation 
or be LMI representable if 

n 

S = {x eMJ" : Ao + '^AiXihO} (1.1) 

i=l 

for some symmetric matrices Ai. Here the nota- 
tion X yO{y 0) means the matrix X is positive 
semidefinite (definite). Obvious necessary con- 
ditions for S to be LMI representable are that S 



must be convex and 5 must have the form 

5 = {xgK" : gi{x)>0,--- ,9m{x)>0} (L2) 

where gi{x) are multivariate polynomials; such 
are called basic closed semialgebraic sets. 

It turns out that many convex sets are not 
LMI representable, see Helton and Vinnikov |HV07j . 
For instance, the convex set 

{x G : l-ixi + xl) > 0} 

does not admit an LMI representation. However, 
the set S is the projection onto x-space of the set 



S := \ {x,w) G X 
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in M which is representable by an LMI. 

More generally a set S C M" is said to be 
semidefinite representable or SDP representable 
if S can be described as 



S 



{ 



3m; e M^^s.t. 



M 



A + Y^ x,B, + WjCj h o}. 



Here A, Bi, Cj are symmetric matrices of appro- 
priate dimensions. Conceptually, one can think 
of S as the projection into of a set S in 
j^{n+M) leaving the LMI representation: 



S 



(n+M) . 



n M 

A + ^a;,S, +^WjCj ^ o|. (L3) 



i=l 
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The representation (|1.3p is called a semidefinite rep- 
resentation or SDP representation of the set S. We 
refer to the wj as auxiliary variables. 

The key use of an SDP representation is illus- 
trated by optimizing a linear function £'^x over S. 



Note that minimizing 
problem 



£ X over S is equivalent to 



mm 



£^x, 



which is a conventional LMI, so can be attacked by 
standard toolboxes. Nesterov and Nemirovski ( [NN94| ) 
in their book which introduced LMIs and SDP gave 
collections of examples of SDP representable sets thereby 
leading to: 

Question: Which convex sets S are the projection 
of a set S having an LMI representation? 

In §4.3.1 of his excellent 2006 survey |Nem06| . Ne- 
mirovsky commented "this question seems to be com- 
pletely open" . Now much more is known and this pa- 
per describes both qualitative theory and SDP con- 
structions. 

Recently, Helton and Nie |HNHIHN2| proved some 
sufficient conditions that guarantee the convex set 
S is SDP representable. For instance, one sufficient 
condition is called the so-called sos- convexity or sos- 
concavity. A polynomial f{x) is called sos-convex if 
its Hessian matrix V'^f{x) ~ W{x)'^W{x) for some 
matrix polynomials {W{x) is not necessarily square). 
A polynomial g{x) is called sos-concave if —g{x) is 
SOS-convex. Helton and Nie |HN1| proved the follow- 
ing theorem: 



In this section, we assume every gi (x) is a sos-concave 
polynomial. A natural SDP relaxation of S is 

R={x: 3y s.t. gix,y)>0,Mdix,y)hO}. (2.4) 

Here g{x,y) is a vector valued linear function and 
Md{x, y) is a matrix valued linear function defined in 
what follows. The integer 2c? is the minimum upper 
bound of the degrees of gi{x). The vector g{x,y) is 
of the form 



Theorem 1.1 ( |HN1| ). If every gi{x) is sos-concave, 
then S is SDP representable. 

An explicit construction of one SDP represen- 
tation of S when every gi{x) is sos-concave will be 
given in Section [2l For general polynomials gi{x), 
the constructed SDP representation in Section [2] is 
usually very big. However, when polynomials gi{x) 
are sparse, the SDP representation can be reduced 
to have smaller sizes. This will be addressed in Sec- 
tion [3l 

There are also some sufficient conditions other 
than SOS-concavity that guarantee the SDP repre- 
sentability. For instance, when the boundary of S is 
positively curved, then S is SDP representable. This 
will be discussed in Section SI 

2 General SDP representation 

Suppose 5 is a convex set given in the form 

5 = {a;eM" : gi{x) > 0, • ■ • ,g™(x) >0}. 



9{x,y) = 90 + Xjgi 

i—l 

whose coefficients are such that 
31(2^) 



l<|a|<2d 



9ra{x) 



= -90 + E 

i=l 



E 

l<|Q|<2d 



The matrix Md{x, y) is the d-th order moment matrix 
constructed as 



Md{x,y) = Ao + ^x,A, 



E y^^^o 

1<|q|<2W 



(2.5) 



Here the symmetric matrices Aa are such that 



m.d{x)md{x) 



Ao 



E ^ 

l<\a\<2d 



■ Ar^ 



The notation m.d{x) above denotes the column vector 
of monomials with degree up to d, i.e.. 



radix) = [1 Xl 



xl 



X1X2 



This construction of SDP relaxations of the set S 
was proposed by Parrilo [Par06j and Lasserre [Las06| . 
When every gi{x) is sos-concave, Helton and Nie |HN1) 
proved R = S. This result lends itself to implementa- 
tion which we now illustrate with two examples. Af- 
ter that we improve this SDP construction to exploit 
sparsity structure when it is present in the defining 
polynomials gi. 



Example 2.1. Consider the set S 
g{x) > 0} where 



{ 



X e 



g{x) ^l-{x\+: 



Direct calculation shows 
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So g{x) is SOS-concave. Thus we know S can be repre- 
sented by R constructed in (|2.4[) . which in this spec- 
ification becomes 





1 - 


2/40 - 
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The matrix above is the second order moment ma- 
trix. In this SDP representation, there are 12 auxil- 
iary variables yij. 

Example 2.2. Consider the set S = {x e K" : 1 - 

p{x) > 0} where p is a homogeneous polynomial: 

p{x) = [xXB[x'^]. 
Here d > is an integer and 

B = (fey")l<ij<n h 

is a symmetric matrix, and [x"^] denotes the vector 



d 

X-i Xn 



^1 '''2 

Direct calculation shows 

V^pix) = diag([x'*-i]) ■ W ■ diag([x'*-i]) 

where the symmetric matrix W is defined to be 

W = (fB + - 2d)dmg{B). 

Since _B ^ 0, we also have W ^ 0- So p{x) is sos- 
convex. Therefore 5* can be represented as 

3?/, 1 - ^ hjyd(e,+ej) > 0,Mdix,y) h 

i,i=l 

Here denotes the i-th standard unit basis vector 
of K" and Md{x, y) is the d-th order moment matrix. 

3 Sparse SDP representation 



The SDP relaxations in |Las06[ iHNll lHN2l IPar06| 

have not exploited the special structures of polyno- 
mials 

such as dependence of each polynomial on only a 
few variables (termed sparsity). On the other hand, 
in polynomial optimization the sparsity structure of 



polynomials can be exploited to improve the com- 
putation efficiency of their semidcfinitc relaxations 
[KKWOSl [TasOesprl lNie06l [ND06 . Par03 , WKKMOGj . 
In this paper we show that when the defining poly- 
nomials for S are sparse, their structures can also be 
exploited to get a "sparser" SDP representation. 

This section gives a structured SDP relaxation 
and proves a sufficient condition such that this struc- 
tured SDP relaxation represents S exactly. 

Throughout this section, we assume every poly- 
nomial gk{x) is sos-concavc. Let 

n = {xe M" : a'^x>b}D S 

be a supporting half space and a^u = b for some 
u G dS. When S has nonempty interior, there exists 
Lagrange multipliers Ai > 0, • ■ • , Xm > such that 

m 

a = ^ AfcVgfc(M), \igi{u) = 0, i = 1, • • • ,m. 

fc=i 



Helton and Nie |HNlj showed that the Lagrange 
function 



a^x - & - ^ Xkgkix) 

k=l 

is an SOS polynomial when every polynomial gk{x) 
is sos-concavc. 

Now we suppose the polynomials gk{x) arc struc- 
tured such that, for any a, 5, A, there is a decomposi- 
tion such that 

rn 

a^x - & - X! ^kgk{x) = (t)x\xi^) H + (t)'^^\xi^), 

k=l 

where each 0^*^ {xj. ) is a polynomial in variables xj. . 
{Ii, ■ ■ ■ , /k} is a partition of the index set {1, 2, • • ■ , n} 
such that Ii Dlj =0 whenever j- xj. denotes the 
sub vector of x whose indices arc in Ii. In other words, 
the polynomials 

'/'a'(2;/i),-- - ,<j}''^^Hxi^) 

are uncoupled. 

Given a polynomial p{x), denote by supp(p(x)) 
the support of p{x), i.e., the set of exponents of ex- 
isting monomials of p{x). If p{x) is SOS and has 
decomposition p{x) = <li{x)j then it holds 

supp((7i(a;)) C convex hull ^— supp(p(a;))^ , 

by Theorem 1 in Reznick [Rez78| . So we define Fi to 
be the maximum lattice set such that 



Fi C convex hull ^-supp(0^*^) 
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Now define symmetric matrices as follows 
mFi(a;/JmFi(x/J^ 

jeh l<|Q|<2Ar 

Here nip- [xj. ) denotes the vector of monomials whose 
exponents lie in Fi. Then define linear matrices 

Mp^ (x, y) = + J2 + J2 ' ■ (3.6) 

jeli l<|a|<2d 

Lemma 3.1. Let a, b, A be the above. Then there are 
symmetric matrices Wi , ■ ■ ■ , Wk ^ such that 

m K 

k=l i=l 

Proof. By the structure assumption, we have repre- 
sentation 

m 

La{x) a'^x -b-^ Xk9kix) 

k=l 

= m{xh) H ^7]k{xi„) 

for some polynomials rji (x/^ ) , • • • , r]K (a;/^ ) ■ We know 
La{x) is nonnegative polynomial and u is one global 
minimizer such that La{u) = 0. Let u^'-* denote the 
subvector of u whose coordinates correspond to the 
variables xj. . Then m^*^ is one global minimizer of 
r]i{xi-). So we know 

k 
i=l 

is SOS by Section 3 in [HNlj . In the above, fix one 
index i and set x^^^ = u^^^ for j ^ i, then we can see 
Vii^ii) ~ ??j ("(*'') must also be SOS in x/. . Further- 
more, by Theorem 1 in Reznick |Rez78j . the polyno- 
mial rii{xi-) — rji{u^^^) has the representation 

mixii) - Vi{u^''') = • Wi ■ mF^{xi^), 

for some symmetric matrix Wi ^ 0. Thus the Lemma 
is proven. □ 

Theorem 3.2. Under the above assumptions, the 
convex set S has the SDP representation 

L= {x eM" : 3y, s.t. g{x,y) > 0, 

MF,{x,y)tO,i = l,---,Ky (3.7) 

That is, S = L. 



Proof. We have seen SQL. If L 7^ 5, then there 
must exist some point x £ L/S. By the Convex Set 
Separation Theorem, there exists one supporting hy- 
perplane of S 

■W = {.T e M" : a'^x > b} D S 

such that a'^u ~ b for some u G dS and a'^x < b. 
Consider the linear optimization problem 

b — min x 

S.t. gi{x) > 0, • • • ,gm{x) > 0. 

Then u is one minimizer for the above. Let Ai > 
0, • ■ ■ : > be the corresponding Lagrange multi- 
pliers. Then, by the previous lemma, we have shown 

m 

a^x - 5 - Y.Xkgi{.x) 

i=l 

K 

= J2 (xii)'^ ■ Wi ■ mp, [xi, ) 

2=1 

for some symmetric matrices Wi, ■ • ■ , Wk ^0. So 
we have 

b = max 7 s.t. 

m K 

oT'x - 7 - J] Afcgi(z) = Y."^Fi{xiiV ■ Wi ■ mp^{xi^) 

1=1 i=l 

- ,\m>0,Wl,- - ,Wk>0. 

The dual of the above SOS program is 

min a^^a; s.t. x G L. 

Since i; G L, by weak duality, it holds b < x, which 
contradicts the previous assertion a^x < b. □ 

Now let us show some examples for the sparse 
SDP representation constructed in (|3.7|1 . 

Example 3.3. Consider the convex set 

5 = {.T G M" : g{x) 1~ {xl+xl+xiX2+xl) > 0}. 

Obviously g{x) is sos-concave. The convex hull of 
^isupp(g)^ contains only the following integer points: 

(0,0), (1,0), (2,0), (3,0), (4,0), (0,1). 
By the sparsity theorem, S can be represented as 



1 


- 2/80 


- 2/20 


- 2/11 


- 2/02 > 
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Xl 


X2 


2/20 


2/30 2/40 


Xi 


2/20 


2/11 


2/30 


2/40 2/50 


X2 


2/11 


2/02 


2/21 


2/31 2/41 




2/30 


2/21 


2/40 


2/50 2/60 


yso 


2/40 


2/31 


2/50 


2/60 2/70 


2/40 


2/50 


2/41 


2/60 


2/70 2/80 



The matrix above is the sparse moment matrix con- 
structed in (|3.6p . There are totally 11 auxiliary vari- 
ables yij. 
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Example 3.4. Consider the set S* = {x G R" : 1 - 
p{x) > 0} where 



2d I. 

xf 



4=1 



k=l 



k\ 



Obviously p{x) is sos-convex, because each univari- 
ate polynomial pi{xi) is convex and hence sos-convex. 
Thus S can be represented as 

n 2d (i) 



where Hi{xi,y^'^> 


) are 


defined 


as 






" 1 


Xi 


(») 
2/2 ■ 

(0 

2/3 ■ 

(*) 

2/4 • 


(») 1 

■ 2/d 




Xi 

(i) 
2/2 


(i) 
2/2 

(«) 
2/3 


■ 2/dii 

• yd+2 








2/d+2 • 


it) 

■ y2d J 



The symmetric matrices Hi{xi,y^'''^) arc sparse mo- 
ment matrices constructed in (j3.6[) . There are totally 
2n{d — 1) auxiliary variables 

4 Positive curvature condition 

Section[2]and Section[3]show the explicit construction 
of SDP representation when all the defining polyno- 
mials gi{x) are sos-concave. If some gi{x) is not sos- 
concave, these constructions usually do not represent 
S. However, there are other sufficient conditions that 
guarantees S is SDP representable. which is called 
positive curvature. 

Assume S in (jl.2p is convex, compact and has 
nonempty interior. Denote by dS the boundary of 
5. Let Zi = {x : gi{x) = 0} and note dS C UiZ^. 
We say the defining functions of S are nondegenerate 
provided Wgi{x) ^ for all x G ZiHdS. The bound- 
ary of S is said to have positive curvature provided 
that there exist nondegenerate defining functions g.; 
for S such that at each x G dS fl Zi 

-w^V^g,(.T)w >0, yO^v eVg^{x)^, (4.8) 

in other words, the Hessian of gi compressed to the 
tangent space (the second fundamental form) is neg- 
ative definite. A standard fact in geometry is that 
this does not depend on the choice of gi{X). 

Obviously, necessary conditions for S to be SDP 
representable are that S must be convex and semial- 
gebraic (dcscribablc by a system of polynomial equal- 
ities or inequalities over the real numbers). The fol- 
lowing, Theorem 3.3 of [HN2] . goes in the direction 
of the converse. 



Theorem 4.1. Suppose S is a convex compact set 
with nonempty interior which has nondegenerate defin- 
ing polynomials S = {x € R" : gi{x) > 0, • • • ,gm{x) > 
0}. If the boundary dS is positively curved, then S is 
SDP representable. 

If S is convex with nondegenerate defining func- 
tions, then its boundary has nonnegative curvature. 
Thus the positive curvature assumption is not a huge 
restriction beyond being strictly convex. The nonde- 
generacy assumption is another restriction. 

Finally comes an example where the defining poly- 
nomial is not concave but the boundary has positive 
curvature. 



Example 4.2. Consider the set 

= {x G M" : g{x) := xiX2 ■ ■ - Xr. 



1 > 0}. 



We can easily see that S is convex but the defining 
polynomial g{x) is not concave. Note that 



Vg(:r) ^ rj_ J_ 
g(x) + l Ixx X2 



1 

XiX2 



1 

XiX2 









We claim that the boundary dS has positive curva- 
ture, which is justified by the following observation: 

-V^g{x) + Vg{x)^g{xf 
h {g{x) + l)diag (J^, J^, . . . , 0, V.T G dS. 



Since dS has positive curvature. Theorem |4?T] guar- 
antees S has an SDP representation whose construc- 
tion was in Section 5 in |HN1| . 

5 Concluding remarks 

This paper gives an explicit construction, (|2.4p . of an 
SDP representation for a convex set S and a sparser 
one p.7p when polynomials gk{x) arc sos-concavc. 
There are also some other constructions of SDP relax- 
ations |Las06[ iHNll |HN2] for S, which are also SDP 
representations of S when gk{x) are strictly concave 
on the boundary 55* of S or when the boundary dS 
has positive curvature. 

In theory a hierarchy of SDP relaxations converg- 
ing to S within finitely many steps can be constructed 
when the boundary dS has positive curvature (weaker 
than our hypothesis). However, these refined con- 
structions of SDP representations arc usually more 
complicated than (|2.4|1 or (|3.7|1 . for example, usually 



5 



it is difficult to predict which step of their hierarchy 
of relaxations represents S exactly. In contrast, the 
size of construction (|2.4[) or (|3.7|) is explicit. We refer 
to [HNT| [HN2] for more details. 
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